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Abstract. A large deviation function mathematically characterizes the statistical 
property of atypical events. Recently, in non-equilibrium statistical mechanics, large 
deviation functions have been used to describe universal laws such as the fluctuation 
theorem. Despite such significance, large deviation functions have not been easily 
obtained in laboratory experiments. Thus, in order to understand the physical 
significance of large deviation functions, it is necessary to consider their experimental 
measurability in greater detail. This aspect of large deviation is discussed with the 
presentation of a future problem. 



1. Introduction 

hen observing a time series of some fluctuating quantity at discrete times, one may find 
an atypical event that occurs during a time interval. In many cases, atypical events 
might be negligible because of the low frequency of their occurrence. However, there 
might be cases where such atypical events lead to a substantial effect, as in the cases 
of seismic events, economic activities, and evolution of species. In such cases, it is 
significant to determine the frequency of atypical events. 

Atypical events are precisely formulated as follows. For mathematical simplicity, a 
time series is assumed to be described by a discrete-time Markov chain for a finite set of 
states. The transition probability from y to x is denoted by T xy . The matrix T satisfies 
J2 X T xy = 1, and it is assumed to be irreducible. The initial state at time is fixed as 
xq. The probability of a trajectory cu — (xx, x%, ■ ■ ■ , x T ) is expressed as 

V{u) = T XtXt _ 1 ---T XiX0 . (1) 

Let J xy be a quantity defined at the transition to x from y. The time average of J xy 
during the time interval [0, r] is expressed as 

J(u) = \Y j J XnXn _ 1 . (2) 

Here, the law of large numbers is assumed. That is, J{oS) almost surely converges to a 
value J* in the limit r — > oo. When J{lS) deviates from the typical value J*, the time 
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series u is considered to be atypical. The probability of the deviation is low for finite 
but large r; this probability is expressed as an exponential function of r: 

Prob(J) ~ exp(-r/(J)) (3) 

for large r [TJ [2j [3j H] . This is called a large deviation property with a large deviation 
function /(</). The frequency of atypical events is characterized by I(J). 

At this point, let us recall that the fluctuation theorem [5], which is a landmark in 
the recent development of non-equilibrium statistical mechanics, states the symmetry 
property of the large deviation function of the entropy production. The fluctuation 
theorem holds for a wide class of systems and is useful for deriving several non- 
equilibrium relations in a systematic manner. However, despite universal validity, its 
applications are still limited to the formal aspects of non-equilibrium systems. 

It should be noted that large deviation functions are hardly measurable in 
experiments, except in the case of small fluctuations, because they characterize a small 
frequency of atypical events. For this reason, physicists have not encountered large 
deviation functions in experiments. If the term "physical quantity" is used to describe 
a quantity that can be measured in experiments, then a large deviation function cannot 
be considered a physical quantity. Such disadvantage in the experimental measurability 
of large deviation functions may be related to limited understanding of the physical 
significance of the fluctuation theorem. Thus, it would be a remarkable achievement if an 
experimental method for quickly obtaining I(J) were to be devised. Recent development 
and future prospects of this achievement are briefly introduced in this Comment, as is 
implied by the title of this Comment, "Physics of Large Deviation." 



2. Basic idea 



The key idea of the experimental determination of I(J) involves a biased ensemble 
expressed as 

v ^ - ~ziSr< (4) 

where the normalization constant Z(h, r) is determined by 

Z(h,r) = J2e hTJiul) V(uj). (5) 

The quantity h in dlj is called a biasing field or a counting field. Here, the saddle-point 
calculation result for large r is as follows: 

Z(h,r)~ J2e T{hJ - I(J) \ 
j 

t sup j{H J -1 (J)) 



which leads to the definition of G(h) as 

G(h) = swp[hJ - I(J)]. (7) 
j 
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This is the Legendre transform of I {J). The inverse transformation is then expressed 
as 



This expression indicates that the large deviation function I (J) is equivalent to G(h). 
G{h) is called the scaled cumulant generating function, because the k-th order derivative 
of G(h) at h = is related to the k-th. order cumulant of J . 

Now, suppose that the biased ensemble (@| can be generated experimentally. Let 
( ) h be the expectation with respect to the biased ensemble (jlj). Then, (J) h can be 
easily obtained in the experiments. Let J^ t = lim T ^ 00 ( J) h . From the following 
equation is derived. 



The integration of this relation yields 



That is, G(h) (and I(J) through (jS])) is determined by the measurement of for 
< h' < h. Thus, the problem can be solved by generating the biased ensemble (jlj) in 
the experiments. 

It should be noted that the biased ensemble can be generated in numerical 
experiments by a cloning method. (See Ref. [6] for a recent related study in non- 
equilibrium statistical mechanics.) However, it cannot be performed in laboratory 
experiments. Experimental operations are those of adding an additional force or 
changing the temperature, which may be expressed by modifications of the transition 
matrix. Now, the problem becomes that of determining the modified transition matrix 
T£ that generates the biased ensemble V h (uj) in the large r limit. 

3. Variational principle 

The transition matrix T h is characterized by a variational principle. Its mathematical 
derivation is described below. A set of transition matrices compatible with T xy is denoted 
by Vt- (For R xy e Vt, R xy > only when T xy > 0.) Let lZ(u) be the path probability 
generated by a transition matrix R in Vt- The application of Jensen's inequality to the 
trivial identity 



I(J) = sup[hJ - G(h)\. 



(8) 



h 




(10) 




(11) 



leads to 




(12) 
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Owing to the law of large numbers, this is rewritten as 



G(h)>J2^yPj 



hJ xy - log 

J-xy 



(13) 



where p R is the stationary distribution of the transition matrix R. (That is, R xy Py 

On the other hand, (jl]) and (jSJ) lead to 

hrj (u) — log 



G(h) = lim - 

t— >oo T 



(14) 



Multiplying the both-hand sides by V h (u)) and taking the summation over all histories 
u), one has 

nrj(u) — log 



G(/i) = lim - V?'' 



Again, owing to the law of large numbers, ( 1T5|) is rewritten as 



■'-y 



rph 

kJ X y - lOg 



T 



■>ll 



From ( {TBI) and ( TIB"]) , the following variational formula is obtained: 



and 



G(h) = max.$(h,R) 



T h = Argmax$(/i, J R), 
Rev T 



(15) 



(16) 



(17) 



where the function Q(h,R) has been defined as 



^(h,R) = J2 R -yP. 



hi 1 R 

hJ X y ~ l0 Q 



xy 



xy 



(19) 



Formula (ITT)) is a well-known formula in large deviation theory. (See, for example, page 
81 in Ref. [TJ or page 284 in Ref. [2]. See also Ref. [TJ, which reports the formula.) 

Furthermore, from the Perron- Frobenius theory for irreducible matrices, it is found 
that there exist a positive vector </>* and a positive constant A such that 

Y,<i>> hJxy T X y = \<t>;, (20) 

x 

where (jSJ) and ([7]) lead to G{h) = log A. Then, with the definition 

R h J = ^ x T xy e hJ ^r y ^ (21) 

for any positive vector <fi, where the constant /jl is determined as the normalization 
condition J2 X R X 'J' = 1, it is confirmed that T h = R! 1 ^* . (Substitute T h = R h ' 4 '* into 
ffTBl .) The result indicates that 



G(h) = max$(/z, J R M ) 

4>>o 



(22) 
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and 



<p* = Argmax^O,^). 



(23) 



4>>o 



That is, the set of variational parameters Vt is reduced to a set of positive vectors. 

In this manner, the transition matrix that generates the biased ensemble is 
characterized by the variational principle. The best transition matrix to optimize the 
function R) can be obtained by considering modifications to the system. The 
formulas for continuous-time Markov jump processes and Langevin systems can be 
directly obtained by considering an appropriate limit for (1221) with ( 1T91) . The resulting 
formulas are equivalent to those reported in Refs. [TOl (TTJ . It should be noted that the 
formulas are considered to be an extension of those derived for systems with the detailed 
balance property [H[9]. 

Now, the main message of Refs. [TOl [TT] is that the variational parameter <p x 
corresponds to a potential function for physical models that are described by continuous 
time Markov jump processes and Langevin systems. That is, for these cases, the 
optimization can be considered in laboratory experiments. This indicates that the 
biased ensemble is generated experimentally so that the large deviation function can 
be obtained quickly in the experiments. The experimental determination of the large 
deviation function for a single Brownian particle under a non-equilibrium condition was 
demonstrated in Refs. [10J [11] . 

4. Future problem 

The result appears to be very promising. However, the complication in the result can 
be observed immediately. In the case of a single particle, only the external potential 
needs to be controlled in order to obtain a biased ensemble; however, the degrees of 
freedom of dynamical evolution rules increase exponentially with the particle number. 
For example, when a system consisting of two particles is considered, one needs to 
modify the interaction potential between the particles in addition to the modification 
of the one-body potential. In this regard, (1231) is formally correct; however, it may not 
be applicable to many-body systems. 

A one-dimensional lattice gas model consisting of N sites in contact with particle 
reservoirs at two ends is studied so as to investigate the problem more concretely. The 
state of the system is denoted by cr = (<Tj)^ 1 , where o~j G {0, 1}, and the transition rate 
in the Markov jump process (or the transition matrix in the Markov chain) is expressed 
as a 2 N x 2 N matrix. Now, by using ( !22l . the optimization problem is formulated in the 
set of 2^ dimensional positive vectors. Each positive vector corresponds to a potential 
V as a function of cr. The potential can be formally expanded in the form 



where, in principle, fc-body, iV-range interactions V^ k ' are included. The space of the 
variational parameters is too large to be controlled. 




(24) 
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Let us assume that experimentalists can control only a one-body potential for 
a macroscopic system; this assumption corresponds to the case where only the first 
term in the expanded form ( 1241) can be considered for a system with large N. An 
optimistic consideration that the description of macroscopic behaviors does not require 
the complete information of microscopic details of the system leads one to expect that 
the control of a one-body potential is sufficient to solve the optimization problem. On 
the other hand, cautious researchers would not have such an ill-founded expectation. In 
any case, the question may be mathematically stated as follows: Can the optimization 
problem with a 2 N -dimensional vector as a variational parameter be effectively reduced 
to an optimization problem with an N -dimensional vector as a variational parameter in 
the macroscopic limit? 

Obviously, such a reduction is not applicable to all systems. Then, an interesting 
future problem is to obtain a condition under which the reduction indeed occurs. This 
problem may be related to the manner in which microscopic descriptions are connected 
with macroscopic descriptions in non-equilibrium systems. Hopefully, studying this 
future problem will provide a new direction to non-equilibrium statistical mechanics. 
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